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Priority-Based Search for Combinatorial Optimization Problems 
Field of the Invention 

[0 1 ] The invention relates generally to combinatorial optimization problems, 
and more particularly to search techniques for finding optimal solutions. 

Background of the Invention 

[02] Combinatorial problems deal with applications where multiple elements, 
e.g., items or tasks, can be combined or performed in various orders. If the number 
of elements and possible orderings is large, these problems are extremely difficult 
to solve. 

[03] Well known combinatorial problems include the traveling salesman and 
delivery truck problems, transportation scheduling (airline, trains, buses), job shop 
scheduling, class and student scheduling, utility management (power, gas, water, 
sewage), load balancing in power and communications networks, finding the best 
locations of cell towers, and most packing or lay-out problems. 

[04] For many combinatorial optimization problems, it is necessary to search 
a very large number of possible solutions for an optimal best solution. One type of 
search is a greedy search. Greedy searches usually find the optimal or global 
solution for some problems, but may find less-than-optimal solutions for some 
instances of other problems. 
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[05] A subclass of the greedy search is conventionally known as a priority 
algorithms, see Angelopoulos et al, "On the Power of Priority Algorithms for 
Facility Location and Set Cover" APPROX, pp. 26-39 2002, and Borodin et al., 
"(Incremental) Priority Algorithms," SODA, pp. 752-761, 2002. Priority 
algorithms are especially effective for solving combinatorial packing problems and 
scheduling problems. They are also fast and easy to implement. 

[06] Priority algorithms can be classified as fixed or dynamic. A fixed priority 
algorithm assigns all priorities at design time, and those priorities remain constant. 
That is, the fixed priority algorithm requires an ordering of all elements in the 
problem instance. The algorithm is greedy. This means that the value assigned to x t 
is only a function of previously assigned elements and the value of an element is 
fixed after it is decided. Fixed-priority algorithms tend to be the simplest to 
implement. 

[07] A dynamic priority algorithm assigns priorities at run time, based on 
execution parameters. In the dynamic priority algorithm, the remaining elements 
are re-ordered after the placement of an element according to run time dynamics. 
As a general characteristic of prior art priority algorithms, the highest-priority 
element is always placed at each step. As the invention shows, this may not be 
desirable in all cases. 

[08] As shown in Figure 1, a typical priority algorithm 100 for an 
optimization problem 101 starts with an instance / 102 of the problem. An ordering 
function o 1 10 produces an ordered list of elements 103. A placement function/ 
120 takes the ordered elements, one-by-one to produce a solution S 104. The 
placement function maps a partial solution and an element to a priority value for 
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that element. If the priority function is dynamic, then step 1 10 is repeated after 
placing an element. 

[09] However, it is possible that even better solutions exist 'near' good 
solutions found by priority algorithms. Therefore, it is desired to improve priority 
algorithms to search for these better solutions. 

Summary of the Invention 

[0 1 0] For combinatorial problems, a priority algorithm usually finds a good 
solution. However, there are often better solutions 'nearby'. The invention 
provides a natural and generic approach to find these better solutions. 

[Oil] In the priority algorithm according to the invention, an ordering function 
produces an ordering for an instance of the problem. The ordering is then modified 
in a special way to produce additional orderings 'near' to the initial ordering. A 
process for re-ordering and a distance metric for nearness is provided. Then, a 
placement function of the priority algorithm is applied to the modified ordering to 
find a better solution. In particular, the measure of nearness uses the Kendall-tau 
distance. Other distance metrics can also be used. 

[012] The method according to the invention can use an exhaustive or a random 
modification. As an advantage, the modification of the ordering according to the 
invention is independent of the application domain, while the particular ordering 
and placement functions for a conventional priority algorithm are usually 
constructed to be effective for a particular application domain. 



3 



MERL-1481 
Leshetal. 

[013] The invention does not require any additional domain-specific 
knowledge. A generic implementation of the invention treats the components of 
the priority algorithm as black boxes. Thus, the invention can be applied to any 
application that uses a priority algorithm, e.g., rectangular strip packing, jobshop 
scheduling, edge crossing, and number partitioning. 

Brief Description of the Drawings 

[014] Figure 1 is a flow diagram of a prior art priority algorithm; and 

[015] Figure 2 is a flow diagram of a priority algorithm according to the 
invention. 

Detailed Description of the Preferred Embodiment 
[016] Priority Algorithm 

[017] As shown in Figure 2 for a priority algorithm 200 according to the 
invention, a combinatorial optimization problem 201 is characterized by a universe 
U of elements E, and a universe Fof values. 

[018] A problem instance / 202 includes a subset of elements £c(/.A 
solution is a mapping of elements in E to values in V. The problem definition also 
includes a total ordering, with ties, on solutions. Because only a subset of the 
elements in E may have values, partial solutions exist 



4 



MERL-1481 
Lesh et al. 



[0 1 9] An ordering function o 2 1 0 maps the problem instance / 202 to an 
ordered sequence of the elements x h ...,x n 203 in /. 

[020] The order of the elements is modified 220 as described in greater detail 
below. The sequence 204 can be called a nearby ordering. The effect of the re- 
ordering is that the highest priority element is not necessarily placed first, as in the 
case of the prior art. 

[021] A placement function / 230 is applied to the re-ordered elements x'\ 9 
x' n 204 to generate a solution S n 205. The placement function maps a partial 
solution and an element to a priority value for that element. 

[023] Then, the modifying, and placing steps are repeated 250, for the same 
ordering 203 but different nearby re-orderings 204, until a termination condition 
240 is satisfied, e.g., a best solution S b 206 is selected, or a predetermined number 
of iterations is reached. 

[024] Modified Orderings 

[025] Instead of using the ordering 203 provided by the ordering function 210, 
the priority algorithm according to the invention modifies 220 to generate the re- 
ordered list 204. The re-ordered list does not necessarily have the highest-priority 
element as the first element in the list for placement, and the placement function is 
applied only after re-ordering. 
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[026] As stated above, there are often better solutions 'nearby'. The 
modification step 220 provides such nearby solutions. Such solutions are obtained 
from re-orderings that are near the ordering 203. 

[027] Kendall-taii distance 

[028] In order to understand the "nearness 5 of re-ordered list, as distance metric 
is provided, preferably the Kendall-tau or 'bubble-sort' distance, see Stuart, 
Kendall's tau, Kotz et al., editors, Encyclopedia of Statistical Sciences, Volume 4, 
pp. 367-369, John Wiley & Sons, 1983, other distance metrics such as Spearman- 
rho, Goodman-Kruskal gamma, and Yule Q can also be used. 

[029] Formally, the Kendall-tau distance is defined as follows. Consider two 
orderings k and a of an underlying set {x\, ; x n }. If ;r(i) is the position of* z in the 
ordering, then the Kendall-tau distance 
d Ken (z, cr)= Y j I[7r(i)< n{j) and a(i)> 

\<i<j<n 

where I[z] is 1 when expression z is true, and 0 otherwise. Informally, the Kendall- 
tau distance is the minimum number of transpositions needed to transform the 
ordering n to the ordering a . 

[030] Modification Method 

[03 1] The modification can be done in a number of different ways. One way is 
to randomize the ordering to obtain the nearby orderings, and then to measure the 
distance between the ordering 203 and the nearby ordering to see if any are 
acceptable. However, this process may do extra work. 
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[032] Decision Vector 

[033] In the preferred embodiment, the modifying step 220 applies decision 
vectors a 221 to the ordering n 203 of elements x u . . x m such a value |a - 1„| is 
the Kendall-tau distance between n and the re-ordering a 204, where the norm is 
the LI distance, and \ n is an all-ones vector (1, 1, 1) . As an advantage, the 
decision vector can be predetermined to meet the distance metric. In other words, 
the re-ordering is performed in a controlled manner. 

[034] In addition, the decision vector a with fields a 2 , . . a n ) allows the 
modifying to be generalized for both fixed and dynamic priority algorithms. The 
field aj represents the remaining element to consider at selection step in the 
reordering. If field a } = k, then the £ th -highest-priority element is placed in step j\ 

[035] With the above definitions, and in context with the invention, priority 
algorithms can be characterized, in the context of the invention, by how they select 
decision vectors to evaluate. For example, the fixed and dynamic priority 
algorithms evaluate a single ordering corresponding to an all-ones decision vector 
l n = (1 , 1, . . ., 1), i.e., the modifying step is a null operation. 

[036] Anytime Priority Algorithm 

[037] In addition, the invention enables a new class of priority algorithm, 
namely 'anytime' priority algorithms. In computer processing generally, an 
anytime process can be stopped after any number of iterations and still produce a 
valid result. 
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[038] The anytime priority algorithm is an extension of a fixed or dynamic 
priority algorithm. As the name implies, the anytime algorithm can be halted after 
any number of iterations, and returns the best solution it has evaluated so far. This 
is in contrast with prior art priority algorithms, which must always complete. 

[039] The anytime priority algorithm applies the placement function to random 
orderings. In terms of decision vectors, this corresponds to selecting each element 
di independently and uniformly at random from [1, n-i + 1]. The totally random 
anytime priority algorithm continues to apply its placement function to new 
orderings of the problem elements until terminated. 

[040] Exhaustive Priority Algorithm 

[041] An 'exhaustive' anytime priority algorithm considers eventually all 
possible n\ decision vectors with 1 <a t < n-i + 1. This set of vectors produces 
re-orderings is O n . Considering all n\ decision vectors is impractical. Therefore, the 
order in which the decision vectors are evaluated is important for performance. The 
invention defines a total ordering on O n as: 

a<bii\a-\ n \<\b-\ n \ 
if Ja = \b - then a < b is true if and only if a comes before b in the 
lexicographic ordering for vectors. The intuition for this total ordering on decision 
vectors is derived from fixed priority algorithms. In other words, the invention 
searches outward from the ordering in according to increase Kendall-tau distances. 
For example, transposing each pair of adjacent elements, then transpose elements 
one apart, and then two apart, and so forth. 
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[0421 Probabilistic Priority Algorithm 

[043] For some problems, small perturbations to an element ordering tend to 
make only a small difference in the quality of the solution. In this case, larger 
perturbations can be more effective. This motivates a probabilistic search strategy. 
This strategy selects decision vectors at each step randomly according to some 
probability distribution. 

[044] In terms of the decision vector, the decision vector a is selected with a 
probability proportional to g(\a - l n \) for some function g, e.g., the function (1 -/?)'* 
" lfll for some parameter p. This determines how near the ordering the randomly 
elected orderings tend to be. In the case of the fixed priority algorithm, this has the 
following interpretation. 

[045] If r is the ordering, then at each step an ordering cr is selected a 
probability proportional to (1 - pY Ken ^ a \ t 0 se lect the decision vector according 
to the above distribution, each a { is determined as follows. Initially, q is 0. Repeat 
the following: select with probability p, terminate and output a x ? = q + 1; otherwise 
increment q by 1 , modulo n-i + 1 . 

[046] In other words, the first element x x of the ordering 203 is selected to be 
the first element x\ of the nearby ordering with a probability p. If the element is 
not selected, then the next element is tried, and so forth, until the last element of 
the ordering is reached, and then to repeat the probabilistic selection from the top, 
until all elements of the ordering have been moved to the nearby ordering. Here, 
the value of the probability controls how close the re-ordering is to the ordering. 
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[047] Both an exhaustive and probabilistic algorithms apply equally well to 
dynamic priority algorithms. Because the ordering changes as elements are placed, 
this ordering cannot be tied directly to the Kendall-tau distance between orderings, 
as in the case of the fixed priority algorithm. 

[048] Other variations include the following. There can be several ordering 
functions, with the search cycling though the functions, or apply several ordering 
functions in parallel. There can also be several placement functions. 

[049] For some constant k, the last k fields of the decision vector can be 
truncated, so that the exhaustive search is only on the first n - k fields. 
Alternatively, all possible values for only the last k fields can be considered. This 
can be done by setting the corresponding fields to zero. 

[050] In addition, the ordering 203 can be replace 260 when a particular re- 
ordering leads to a better solution than that corresponding re-ordered list can 
replace the ordering. Decision vectors are then applied from the new ordering. For 
an exhaustive search, the decision vector is restarted from the all-ones vector, in 
this case. 

Effect of the Invention 

[05 1] The invention exploits the fact that often better solutions exist near an 
ordering of a priority algorithm. The placement function and the ordering of most 
priority algorithms encode valuable domain-specific knowledge for solving the 
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problem. However, applying the placement function only to the ordering does not 
fully exploit this knowledge. 

[052] The invention exploits the knowledge in priority functions. The search 
according to the invention can be extended to any priority algorithm. For many 
practical problems, the search according to the invention can significantly improve 
the solution found by a priority algorithm dramatically after evaluating only a 
small number of re-orderings. In particular, the average result of the randomized 
search can be as much as 20% better than the average result obtained by a prior art 
priority algorithm for some problems. The results continue to improve as the 
search evaluates additional orderings. 

[053] Although the invention has been described by way of examples of 
preferred embodiments, it is to be understood that various other adaptations and 
modifications may be made within the spirit and scope of the invention. Therefore, 
it is the object of the appended claims to cover all such variations and 
modifications as come within the true spirit and scope of the invention 
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